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ABSTBXCT 

Using the evaluation of day care programs at the 
state level as a basis, this document focuses on the metjiodology, 
logistics, politics., and benefits of state-vide efforts, particularly 
as these efforts relate to the impact of day care services on the 
children served* Since every evaluation effort must be individually 
tailored, and each state's day care needs and services are i& some 
vays unique, a selected fev of the generic issues that others must 
address as they undertake or participate in state*vide evaluation 
efforts are focused on* The examples used emanate from the collective 
experiences of the authors in Pennsylvania, Rest Virginia, South 
Carolina, and Arkansas* (Author/DEP) 
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We have been asked to address fbur broad questions relating to the 



conduct of the evaluation of day care at the state level* The questions 



focused our attention on the methodology, logistics, politics, and benefits 
of state wide efforts— particularly as these efforts relate to the impact 
of day care services on the children served* Since every evaluation 
effort must be individually tailored, and each staters day care needs and 
services are in some ways unique, we have fbcussed on a selected few of 
the generic issues that others must address as they undertake, or partici- 
pate in, state-wide evaluation efforts* Our examples emanate from our 
own collective experiences in Pennsylvania, West Virginia, South Carolina, 
and Arkansas* Ihese issues and exajnp'*.es will be helpful in broadening 
perspectives* 



For the purposes of this paper, an initial distinction needs to be 
made between monitoring and evaluation* Every state has some agency 
designated for monitoring day care as well as other child services* 
Monitoring is an official state responsibility (usually specified by 
law)* To fulfill its monitoring responsibility a state needs a management 
information system which will provide on demand, or according to a time 
schedule, a stable source of accurate data* The purposes of the monitoring 
syst^ are two fold: ^ 



Mopito ring vs Evaluation 
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1* Effort expendature assessment — e»g» How mny children and 
families are served by how many day care systems, centers, or homes, and 
at what cost? 

2» Compliance assessment--e»g» Are prograjns ccmjplying with promul- 
gated regulations, concerning staffing, space, program, safety, cost 
accounting, and the like* Compliance monitoring ususally involves the 
establishment and periodic reference to minimal standards designed to 
insure the health, safety, and welfare of children* 

Evaluation, on the other hand, is concerned with the relative desir- 
ability, adequacy, effectiveness, and worth of services with respect to 
the impact upon service recipients (clients)* Evaluation is concerned 
with the description of program inputs, transactions, and outcomes iov 
children, families, and cononimities, as well as with the benefits accrued 
in relation to costs of operation* 

The concern of the present paper is evaluation* 

Characteristics of "State-Wide" Evaluation 

The characteristics of state-wide evaluation can be differentiated 
from evaluation efforts at the local and federal level* Four features of 
state-wide evaluation efforts stand out as important* They are: (a) The 
size J Cb) The scope, (c) The sensitivity, and (d) The directness of 
impact * While these features are obviously interrelated, the recognition 
of each feature separately provides a framework for highlighting both the 
problems and the benefits of state-wide effbrts* 
Size 

It is evident that state-wide evaluation is an undertaking that 
exceeds in scale all but the most unusual local evaluation efforts* IVhat 
is not so obvious is that state-wide efforts frequently exceed national 
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evaluation effbrts in scale* For example, the national evaluation of 
Project Home Start involved only 16 Home Sta*t Programs with extensive 
summative data provided by only 6 Home Start and 4 Head Start sites 
(Deloria, Coelen and Ruopp, 1974) . The Pennsylvania Day. Care Study 
involved data collection from almost 2000 programs with extensive data 
collection involving multiple visits to over 400 day care centers and 162 
day care homes* Three hundred children were individually tested, 210 
sets of mothers and fathers interviewed and the staff members of sixty 
programs extensively observed* (Peters 1972; 1973) 

The West Virginia Study (Hodges, et al*, 1973) included data from 27 
area welfare offices, 68 non-center day care providers, 15 day care 
centers, 15 area day care workers, 6 chairpersons of boards of directors, 
60 day care center staff members, and so on* 

While these two examples are greatly despariate in size of sample 
evaluated they both represent large and comprehensive efforts* Studies 
of similar magnitude are typical* 
Scope 

First, national evaluations are usually established by a Request for 
Proposal (RFP) to answer specific questions about certain decisions that 
need to be made* State-wide evaluations are usually contracted to address 
a wide range of frequently ill-defined questions* For example, some 
national day care evaluation efforts are focused i^on the cost-benefits 
of specific child/staff ratios* The Pennsylvania Day Care Study was 
designed to simultaneously answer a range of questions relating to the 
impact of day care on children, families, and communities* 

The West Virginia project was designed to determine the scope and 
quality of child care offered in the state; to develop an alternative 
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Modol, or ^todels; compare present services with the /Itefnative Model; and 
propose efficient and effective means for the delivery of this Model, 
(Incidentally, it is important to note that these four purposes reflect 
the generic definition of evaluation as a process) , These purposes required 
study of human resources, transportation, building, welfare system capacity, 
financial resources, community attitudes, and previous written statements 
as a minimum effort- 
Second, and at another level, the scope of state-wide efforts differs 
from most federal evaluations. States have the responsibility for regular 
ting and evaluating all programs within their borders. This includes 
funded as well as non-funded elements of the service delivery system and 
long established as well as new programs. For example, "for-profit," well 
established programs which neither desire nor receive state or federal 
funds may be required to participate, on a non-voluntary basis, in the 
evaluation efforts along with newly established and funded programs. This 
markedly increases the number of conflicting interest groups involved, 

Thirdy the state*s responsibilities toward programs may be more 
multi-disciplinary than federal or local evaluations. State departments 
have the responsibility for the interfacing of a variety of service deli- 
very systems only one of which is day care. State-wide evaluations may, 
therefore, have to be concerned with the day care nutrition program and 
its relationship to other child-feeding and school lunch programs, or the 
interrrelatedness of child health care within day care services to programs 
such as EPSDT, The number of possible examples here is quite large. The 
point is that educational programs delavery and child learning may be 
necessary but certainly not sufficient criteria in evaluating developmental 
child care* How children are managed, fed, protected, rested, screened, 
as well as how they are taught or how they learn are important considerations* 
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Political Sensitivity 

In many ways state-wide evaluation efforts are more politically 
sensitive than either national or local evaluations* State-wide evaluation 
involves more political entities (governmental bodies and levels) than 
does local evaluation, but it does not have the equivalent political 
distance that is found in federal evaluation efforts* People feel that 
they have more direct access to state government than they do to federal* 
Legislators and bureaucrats are better Icnown and are considered more 
accessible* The psychological proximity creates a general feeling that it 
is us^, not they who are malcing decisions* Many more people feel, therefore, 
that they have a ri^ht and r^ponsibility to participate in the decision- 
making process and in the design of evaluation* 
Directness of Impact 

At the state level decisions made on the basis of evaluation data are 
more readily felt by a larger segment of the population* States hold the 
licensing and regulatory power which permits the opening or closing of day 
care programs* States are more prone to have an action orientation and 
have the communication mechanisms necessary to bring about direct and 
relatively immediate impact upon the organizations which they regulate* 
Their span of control is both reasonable in size and relatively comprehen- 
sive* This cannot be said for either the local or federal levels* 

Methodological Issues 

When one takes on responsibilities within a state-vcide evaluation 
effiDrt methodological concerns begin immediately* The first concern, and 
perhaps the most crucial, involves defining the intentions, or objectives, 
of the project* 



ERiC 



6 



6 



Defining Intentions ( Objectives) 

Defining intentions is at least a three step process: 

1, Defining the objectives of the evaluation study* 

2, Defining the objectives of the service that is the focus of the 
evaluation (in this case day care)* 

3, Setting priorities for the selection of objectives actually to 
be studied (within cost and resource constraints)* 

Defining the Objectives of the Evaluation 

If the objectives of the evaluation are not already adequately spelled 
out in the RFP or contract, then the investigator must determine efficient 
methods of defining them. These objectives are usually in the minds of 
those persons who are most concerned with child care delivery in the 
state. Early agreement on the objectives of the evaluation is necessary 
if misunderstanding and disappointment are to be prevented and if the data 
gathered by the evaluation efforts are to be actually used in the state* s 
dec is ion -male ing process. 

Early and open discussion with decision-makers and staff members 
charged with implementing the decisions made is essential. The process of 
worlcing through most of the potential questions that the study can answer, 
with the persons most concemea or involved with the results, serves both 
to direct the worlc of the evaluation team and to reduce the expectations 
of those most directly involved with the study to a scope realistic within 
tite funding and time resources- For example, the principal investigator 
in the West Virginia project worked through every interview item, every 
source of information to be used, every observation instrume *t, with those 
who woidd ultimately propose to their supervisors what was to be done 
about the day care system and who would also be responsible fbr supervising 
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the implementation process* This procedure combinod tho expertise of the 
evaluator with the basic needs of the recipients of the evaluation report* 
Through these efforts many out-of-proportion expectations about the 
extent to which an evaluat-on project alone can solve problems were mitigated* 
Defining the Objectives o£ the Service 

There is ambiguity, uncertainty, and considerable debate as to the 
basic puorposes of day care* This problem has been discussed elsewhere 
(Peters, 1975)- A detailed analysis of the views on day care objectives 
held by elected officials, regulatory agents, program specialists, program 
staff, and parents is presented in Peters (1973 a)* In light of such 
conflicting opinion and expectations, the evaluator is fiDrced to seek out 
authority and concensus for his position* 

When restricting concern to outcomes for children, the objectives for 
day car^ can still include any change in behavior or development deemed 
desirable by the child, the child's parents, educators, or the larger 
society* In an effort to define the desired outcomes more closely, the 
evaluator can survey experts, parents or day care staff (cf. Peters ^ 
Marcus, 1973), search the child development and early childhocd education 
literature (5*g*, Butler, Gotts, Quinsenberry 5 Tliomson, 1971), search out 
legislative and regulatory intents, or derive objectives from developmen- 
tal theory Ce*g*, Kamii, 1971)* 

\ 

f ^ 

In Pennsylvania a concensus approach was employed which used all of 
the above* A list of 72 child objectives as constructed on the basis of a \^ 
literature search, an analysis of federal and state regulations for day 
care, (Holleck, Peters, 5 Kirchkner, 1972) and personal experience of the 
evaluation team- These were then sent to both a sample of day care 
operators in Pennsylvania and a national sample of child development and 
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early childhood education experts* Only those objectives that were endorsed 

beyond chance levels by one or both groups were retained as the objectives 

2 

fbr day care to be studied* 
Measurement^ 

Once the objectives of the evaluation and of the service are defined 
the problems of measurement must be addressed* Many of these are logistical 
in nature, and will be discussed later* Others, such as the existing paucity 
of adequate and appropriate measures for assessing the affective and social 
development of young children, (not to mention the cognitive) are such 
common knowledge (and we have no quick and novel solutions) that they will 
not be addressed here at all* Several points are worth mentioning, however* 

1* "ime* If procedures such as those above are fiDllowed in determining 
the objectives of the study, and if the evaluation is to be tailored to the 
expectations of state personnel, measures will have to be selected, adapted, 
and/or developed differently for each evaluation* A major investment of 
time and money is required to do so, and funding source personnel will have 
to be convinced of the necessity and value of this investment* It coes not 
apy to rush this phase of a project. 

The problem with many state projects is, of course, the highly restric- 
tive time frame from initiation of RFP to initiation and completion of 
project. The West Virginia Study was requested in the early FAll of 1972* 
Work started in November, 1972 and had to be completed -^report finished) by 
March 1, 1973* The total elapsed time: less than six manths* Naturally, 
child outcome data must be relegated to the realm of the unrealistic in such 
a period since no baseline data, no instumients, no, sample, and no design 
had been conceived by the state before start-up in Noveittoer, 1972* Ihis is 
not to cast criticism on any state agency since each of us knows all too 

9 



well the insane lack of lead time provided in the funding of inost ptihlicly 
st5)ported research, development, and evaluation efforts, 

2» Face Validity of Measures* The participation of day care personnel 
in"a state-wide evaluation, including those in state decision-making roles, 
is enhanced by keeping the measures used as concrete anA obvious as is 
possible* Measurement of behaviors that teachers and parents can see as 
direct indicators of the achievement of the objectives of day care create 
fewer questions^ elicit more responses, and produce data which are more 
lilcely to be used for pragram change* Locus of Control or other hi^- 
irtference measures while interesting from a child development perspective, 
are not likely to be accepted well by many parents or teachers in day care 
centers or homes* _ 
Sampling 

Since in many states the potential number of subjects (be they centers, 
homes, children, staff or parents) is large, sampling is desirable and 
essential. However, there are several problems associated with the sample 
selection process* Some of the problems axe simple methodological ones* 
Others are human problems* 

Within any particualr state the day care c*^rvice delivery system is 
complex* The ways in which day care delivered varies* In some states 
ther is both publicly and privately funded center based care* Private care 
includes that which is noa-profit and that which is *'fbr profit*" There are 
family day care homes — again private and publicly funded* Sometimes there 
are extended day care homes or mini-centers* There are experimental programs 
and infant centers* Th^e are licensed programs, approved programs, and 
programs which lie outside the preview of state regulation Qt day nurseries 
in some states)* The persons who are potentially affected by day care 
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include parents, children, the caregivers, consultants, public agents such 
as social case workers, fire marshals, health officers, and so on* In 
addition, the purposes and effects of day care may be diffused throughout 
the community* This multiplicity of levels and persons leads to major 
sampling problems that are not easily resolved* In some states sauqpling 
problems arc made more complex by the fact that various geographical regions 
of the state also reflect ethnic groups, socioeconomic level, life style, 
and cultural differences. 

Generally, the way to confront such a problem is to use a random sampling, 
or stratified random sampling procedure. That is, major strata are defined 
and random san^l:.ng procedures are employed within strato* This procedure 
is basically the one that was employed in the studies with which we are 
familiar* However, two problems with this procedure should be noted* 

1. ITie procedure assumes that the Universe (population) to be sampled 
is known. In the case of family day care homes, where estimates suggest 
that fewer than one in ten are licensed, or registered, with the Department 
of Welfere or other responsible agency this is not the case. For example, 
the Pennsylvania Day Care Study (Peters^ 1972b) a geographic 10% sample of 
day care homes was studied. These were selected from a listing of approxi- 
mately 1600 day care homes licensed, or approved, by the state. No effbrt 
was made to determine how the licensed or approved homes differed from 
others that were not licensed or approved (and not identifiable). Hence, 
the results are at best generalizable only to day care homes where the day 
care home mother was inotivated to follow the legally required licensing 
procedures. 

2. There is little or no evidence presently (avaialbel as to the key c[ 
dimensions, or strata, within which to sauqple. Our state of knowledge is 
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sufficiently sketchy at this time that the principle dimensions of our 
sampling process are, at best, pcorly educated guesses* 

Despite these problems, stratified sampling is still the rost reasonable 
way to proceed* Within that framework, two additional procedures are help- 
ful* 

1* Matrix * Sampling within strata * This is best explained by an 
example- If the object of the evaluation is program improvement — i*e*, the 
focus is on program, rather than individual information, then not all units 
need to be thoroughly measured, FoY" example, not all children need to 
complete all tests or measures to produce program wide data for analysis* 
If we randomly select 10 children from each of 100 programs, and each child 
is administered one of 10 measures (e*g*, language, self-conc^t, social 
maturity and the like,) this yields incon^lete data on each child's progress, 
but does provide N-lOO for analysis of each measure* Such a procedure 
provides adequate information fbr state-wide decisions without spending too 
much time with each program, or in over-testing each child* 

2* Developing m ultiple o verlapping samples * Figure. 1 suggests one 
possible pattern of overlapping samples* In this case a different sample of 
parents, staff, and children are selected for study of specific questions, 
However, since a sub-portion of all three sanr 3s overlap (the shaded area), 
it is possible to interrelate staff behaviors with parent and child outcome 
data. 
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Figure 1 
System of Overlapping Samples 
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Ihere is one remaining sampling problem which should be noted. This is 
strictly a human problem. It deals with the difficulty of convincing the 
non -methodologically sophisticated program personnel and administrators that 
anything less than a 100% sample can produce interpretable and accurate 
results- Program personnel frequently feel that t heir program has not been 
adequately evaluated when only 10 of their children are involved (and they 
could not piclc which ones)* It is even harder to explain when each child 
receives a different test* Similarly, it is difficult for persons who have 
not engaged in research to understand the necessity for random selection. 
It is not uncommon to find persons who wish to include in the sample particu- 
lar persons, particular centers, and particular caregivers because of their 
Icnown strengths or their known wealcnesses* To disallow this preconceived 
idea of what a sample should consist of is frequently a difficult' taslC, 
Worlcing through the sampling process with those who are to receive the final 
report is a health/ way to proceed. The responsibilities of the evaluator 
include the continuing education of the decision-malcer. 
Design 

Sampling considerations are a part of design, but the ultimate questions 
of design are those of comparison. What are the appropriate comparisons 
which will yield Vf*lid answers to the questions being aslced? Essentially 
the comparisons available include: 

1, Those within the smpling strata selected, e,g, , funded vs unfunded 
programs, or one geographical subregion with another, 

2, Those with control or comparison groins, e,g, , (a) using Head 
Start, nursery schools or other programs which have similar child development 
objectives (through differ^it clientele), (h) using waiting list people, 

3, Using fixed, or detexminable standards, e,g, , standardized test noxms* 
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4» Using repeated measures or naturally occurring tirat series or time 
lag designs^ ^*Z*> some children enter day care at age 3^ others at age 4» 
It is possible to compare children in day care at age 4 who have had little 
or no experience in day care with those who have haa a year or more of it, 

Carefully considering and planning for any or all of the above compari- 
sons strengthens the internal and external validity of the study. 

Comparison of the result to a desirable standard may be particularly 
useful* In the West Virginia Study a fortunate strategy was employed* The 
staff of all the offices of welfare throughout the state^ the staff of the 
Central Office^ persons on the Inter-agency Day Care Council^ and all written 
documents prepared by the state prior to the evaluation study^ were used to 
derive a model of day care as seen through the eyes of the -state and as 
modified through the investigator^s own experiences* The procedure of 
constructing the model of day care in this way lent much credibility to the 
established "ideal" standards* The "ideal" then was the basis used for 
comparison with the evaluation data produced* 

Since the West Virginia project did not focus directly on child outcomes 
we will not describe the objectives for children derived in the above manner* 
We will^ however^ indicate the program parenting derived through this process* 
These included the goals of (a) a well-articulated comprehensive system that 
is cost effective^ (b) individual programs should be planned and based on 
goals which specify the behaviors that both adults and children are expected 
to demonstrate^ (d) programs r^re to be differentiated on the basis of each 
child's abilities and needs^ (d) programs should be differentiated as basic^ 
minimal^ and developmental^ (e) programs should include parent education 
designed to improve quality of child-rearing techniques used in homes* 
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Logistics 

Every methodological problem has its related logistical problem* Most 
methodological problems can be overcome if better people, mare money, and 
more time were available. However, the nature of contracting with state 
governments is such, that there are several real, pressing, and more or 
le<;s, universal logistical problems that need to be recognized* 
People Problans 

It is trite to say, "it is hard to get good people nowadays**' In point 
of fact, it is not nearly as hard as it was several years ago* Still, it is 
a real problem to put together a good evaluation team on relatively short 
notice, on soft-money, and for short periods of time* Such positions do not 
hold a great deal of appeal* This creates a problan in the recruitment and 
continuity of top level staff* Selection is made from a pool of people who 
are generally local, and who might otherwise not have employment* (The 
Pennsylvania Day Care Project was sometimes sarcastically called **the wives'* 
project*) 

At the data collection staff level other problems exist* Naivete of 
the observers, testers, and others is difficult to, control unless it is 
possible to have persons who are unaware of the specific intentions of the 
study, but who, at the same time, are competient to use the measures* Such 
persons are difficult to find* At the same time persons who are highly 
knowledgeable about day care are seldom fcaowledgeable about measurement or 
observation* Psychometricians are seldom knowledgeable about day care* In 
either case biases result* 

The solution to all such personnel problems lies in the development of 
adequate training procedures, tjie specificity of instructions, and the 
adequacy of the monitoring system that the investigator establishes to 
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insure the adequate administration of interviews, tests, observational 
schedules and so on* In state-wide studies which involve relatively large 
staffs, such procedures require budgeting of time, money, and personnel. 
Procedurally one should plan on: 

1» Extensive training sessions and workshops. 

2. A staffing pattern which pexmits relatively close supervision by 
persons with a reasonable span of control. 

3* Procedures for frequent checks of reliability and accuracy of the 
data collected. 

4. Procedures fcr obtaining feedback from the sauqple of day care 
program staff, parents, children, and so forth, on the adequacy of the 
performance of the evaluation team staff- 
That is, there should be an adequate formative evaluation system 
designed to assess all aspects of the evaluation process itself. Someone 
must evaluate the evaluators. 
Time and Money Problems 

The logistical problems involved in the study of day care at the state 
level reduce to "How can the answers to questions be achieved in time to 
affect the decision-making process within the financial constraints provided?" 
The evaluator seldom feels he/she has the time or money necessary. 

Yet, in a very real sense. Time is the most important constraint—the 
least flexible parameter of the problem. Given the kinds of personnel and 
methodological problems sighted before, simply supplying a project with 
more money is not likely to lead to better infoxm&tion U^ough it might 
ease the pain.) Rarely, if ever, does the evaluator have the luxury of 
studying the intact of day care on children over long periods of time. 
Terms of office of politicians are too short, developmental studies too 
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long. Given longer periods of ime^ it i^ould be easier to establish better 
measurement systems^ train a better staffs and design a better study- 
However^ unless the information is available when it is needed by state 
program administrators the evaluation has failed to serve its purpose* 
Therefore^ the evaluator must recognize the need to sacrifice some excel- 
lence and elegance in the pursuit of practical and immediate impact* 

There is one other aspect of time that should be noted in the evalua- 
tion of day care at the state-wide or any other level* This aspect has to 
do with **timin^»" Timing is considered a logistical concern because it 
deteirain^ activity priorities and emphases* (It is also a methodological 
consideration of design)* 

There is some evidence that the behavioral and developmental changes 
that occur in children as a result of early childhood education exp-^riences 
are irost marked during the first weeks or months of enrollment in a program 
(cf » Bronfenbrenner^ 1974) » After this initial period gains tend to taper 
off* Similarly^ there is sons indication that shakey marriages tend to 
split apart relatively soon after the Availability of day care makes it 
possible for the wife to become economically independent QAyBvs, 1972), 
Such timing-related changes can critically effect the results of a study 
and can lead to misinterpretations of the impact of day care on its users* 
Logistically^ therefore^ it is important to gear ones activities towards 
gathering data before^ at, and inraiediately after (assumed or suspected) 
critical points* 

Po 1 it ic al j^robl ems 
Evaluation is always political*' It has to do with the allocation of 
resources and that affects power structures. Since state govenuiient is the 
focal point of regulatory power governing day care^ and since the state 
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government is the primary conduit for inoney for day care^ state-wide evalua- 
tion is a major political issue. 
^Vhat should the data show ? 

State-wide evaluation^ as distinct from iDonitoring^ directly reflects 
upon the adequacy of the state government in its establishment of programs 
and expenditure of resources* A state wide program that has no discemable 
effects on the children or families served (or has a negative effect) can 
be a major political liability to those in ofHce* Governors^ legislators^ 
agency administrators have concerns which may not be enhanced^ fostered^ or 
furthered by the study as it develops* The degree to which such persons 
ar** willing and able to accept data^ no matter how reliable and valid^ that 
are at variance with their preconceived notions or political ambitions^ can 
be very problematical— particularly since such persons are also at the 
heart of the funding for the evaluation effort* In a situation where no 
one wants to be "wrong/* the evaluator needs to be especially sensitive to 
issues of objectivity* 

This has been alluded to in previoiis paragraphs but it should be made 
clear here that no investigator is free of the potential repercussions that 
can occur as the result of his presentation of the data* Rigorous reporting 
of the data of course is the hallmark of a good investigator* The investi- 
gator reports what he finds^ puts it in the context of what the, data mean, 
and tries to say these things as fairly and impartially as possible* The 
problem is that an investigator who works closely with a group of people in 
developing the goals^ instruments^ and sample of a study has a difficult 
time divorcing himself from the impact of his report upon those to whom the 
report goes* The impact of a report can be widespread* The report of the 
West Virginia Project is still at the root of major changes in day care 
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delivery in that state* It can affect providers, licensing personnel, the 
whole Department of Welfare, and other agencies having to do with day care, 
such as the Inter Agency Child Care Council, and so forth* These threats 
may be different for different people, so an investigator needs to be aware 
before going into the study of the danger to which he exposes himself* 
Cojnmunication of Results 

The results of an evaluation should be presented in the format most 
facilitative of their use in the dec is ion -male ing process* How to organize 
and present information, as well as the timing of the presentation are 
methodological concerns* The most political issue is to whom the results 
should be made available* Throughout, progress of the evaluation effort 
special care should be talcen to only use appropriate, and previously agreed 
upon, channels for the release of information* 

Benefits 

Throughout much of this paper we have focused upon "issues" and "pro- 
blems" of state-wide evaluation efforts* Partially this is the result of 
the particular questions we were asked to address* Partially, no doubt, it 
is a result of some of our own battle weariness* Partially, it reflects 
our desire to assist others in avoiding some of the mistalces we have made* 
We hope, however, we have not been too negative and discouraging* 

We feel that state-wide efforts at the evaluation and study, of day 
care are of tremendous potential benefit* Our optimism stems from the 
belief that the state is the correct unit of study for the day care system* 
Our reasoning here is both pragmatic and scientific* 

States have the licensing and regulatory power to significantly affect 
the institution of day care* They have an action orientation and can have 
direct and relatively immediate impact upon the organizations which they 
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regulate. The state is close enough, the people are Icnown to one another 
well enough, the communication networlcs are strong enough, that things can 
change rather quiclcly once basic decisions have been made to move in one 
direction or another* As such, evaluation efforts are optimally conducted 
at this level* 

Similarly, a state-wide focus provides the opportunity to influence 
the building of day care programmatically instead of in piecemeal fashion* 
Studying day care at less global units tends to malce the movement piecemeal, 
sporatic, and spasTtiadic* It considerably dimishes the influence of the 
investigators efforts* 

State level analysis seems optional for gaining understanding of day 
care both "close-up^' and ''wide angle**' States are geographically and 
demo graphically broad enou^ units (at least some of them) to capture the 
diversity that is day care* Yet, they are small enough so that the diver- 
sity can be seen within a single whole* Careful sampling permits a close 
loolc at different aspects of day care while simultaneous use, of broad 
survey methods permits integration of the small sample information into a 
broader decision^-malcers perspective* 

Finally, there is no doubt that the information obtained from state- 
wide evaluation efforts can enhance our general knowledge of child develop- 
ment, parenting and intervention* The answers to questions concerning the 
process and impact of day care from ^ evaluation perspective, also provide 
information on questions relating to different forms of child rearing, on 
parent-child relations, on teacher child relations, and, even, in some 
cases, on the effects of some forms of abuse, neglect ^md deprivation* 
Similarly, teaching methods and styles, curricula and materials, and many 
other inqpor tant areas may be studied and^ expanded throu^ state- wide evalua- 
tion efforts* O 1 
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As state-wide dt^ care evaluation efforts increase^ and as information 



on the experience and results are shared, a closer approximation of the 
full potential of these activities will be reached. The more we involve 
ourselves in evaluation at the state level the more we are able to narrow 
the range of our errors of evaluation. Caution is a necessary watchwordt, 
however, for that which can have immediate benefit can also yield inunediate 
harm. Most of the people involved in institutions caring for and teaching 
children are sufficiently aware of the inadequacies, abuses, and strains on 
.children and families suffered in these institutions that wc see no alterna- 
tive but to push for more and more ey;>luative studies and consequent follow- 
up* 
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Notes 

1. This Paper is part of a symposium entitled, "Evaluation of Day 
Care," presented at the Annual Meeting of the American Educational Research 
Association, San Francisco, California, April 20, 1^6» Authors addresses: 
Walter L, Hodges, Department of Early Childhood Education, Georgia State 
University, Atlanta, Georgia 30303; Donald L, Peters, College of Human 
Development, The Pennsylvania State University, University Park, Pennsylvania ^ 
16802. 

2, Details of the survey method employed are found in Peters and 
Marcus, 1972. The measures developed to assess the attainment of these 



objectives are found in Kirchner and Vondracek, 1972, and Kirchner, 1973. 

3. Since field staff may be the only project staff with whom day care 
program personnel have .direct contact, they should be briefed sufficiently 
on overall project design and purposes to answer accurately and diplomati- 
cally all questions raised. Hence, training needs to go well beyond skill 
training for the specific tasks they are to. perform. 
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